Pointing: A component of multimodal instruction
نویسندگان
چکیده
We introduce an algorithm for visual selection of objects when guided by a physical pointer. This is part of a multimodal instruction given to a robot. Our algorithm is implemented and tested with images gathered by a camera mounted on a mobile robot.
منابع مشابه
The Impact of Multimodal Channels on Teaching Idiomatic Expressions to Intermediate EFL Learners with Regard to Their Attitudes
This study was to explore facilitative function of using multimodal channels over single channel presentation and comprehension of idiomatic expressions to Iranian EFL intermediate proficiency learners. Out of a pool of 90, sixty intermediate participants were homogenized by a QPT test, using a quasi-experimental design. They were randomly assigned to three equal groups: WhatsApp-, SMS- and Cla...
متن کاملGenerating multimodal output - conditions, advantages and problems
In natural communication situations, multimodal referent specification is frequent and efficient. The linguistic component are deictic expressions, e.g. 'this' and 'here'. Extralinguistic devices in dialogs are different body movements, mainly pointing gestures. Their functional equivalent in texts are means like arrows and indices. This paper has two intentions. First, it discusses the advanta...
متن کاملThe impact of proactive and reactive focus on form in multimodal settings on EFL learners' comprehension and production of modal auxiliaries
The major objective of this mixed methods research, which considered elements of both quantitative and qualitative research approaches, was to examine the effect of two different types of focus on form instruction, namely proactive and reactive across multimodal vs. traditional input settings on Iranian EFL learners' comprehension and production of modal auxiliaries. The participants of the stu...
متن کاملTowards generation of fluent referring action in a multimodal situations
We have been developing a system that uses natural language in combination with visual information such as pictures and gestures, to generate effective explanations. The experimental system we implemented is for explaining the installation and operation of a telephone with answering machine feature, and simulates instruction dialogues performed by an expert in a face-to-face situation with a te...
متن کاملA Multimodal Approach toward Teaching for Transfer: A Case of Team-Teaching in ESAP Writing Courses
This paper presents a detailed examination of learning transfer from an English for Specific Academic Purposes course to authentic discipline-specific writing tasks. To enhance transfer practices, a new approach in planning writing tasks and materials selection was developed. Concerning the conventions of studies in learning transfer that acknowledge different learning preferences, the instruct...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2000